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Abstract. We show that computability of the Radon-Nikodym deriva¬ 
tive of a measure p absolutely continuous w.r.t. some other measure A 
can be reduced to a single application of the non-computable operator 
EC, which transforms enumeration of sets (in N) to their characteristic 
functions. We also give a condition on the two measures (in terms of the 
computability of the norm of a certain linear operator involving the two 
measures) which is sufficient to compute the derivative. 


1 Introduction 

Theorem 1 (Radon-Nikodym). Let (f2,A,A) be a measured space where A 
is a-finite. Let p be a finite measure that is absolutely continuous w.r.t. A. There 
exists a unique function h £ L 1 (A) such that for all f £ L 1 {p), 

Jfdp = jfhdX. 

h is called the Radon-Nikodym derivative, or density, of p w.r.t. v. 

Is this theorem computable? Can h be computed from p and A? In [3] a 
negative answer was given. 

In this paper we investigate to what extent this theorem is non-computable. 
We first give an upper bound for its non-computability, showing that it can 
be computed using a single application of the operator EC (which transforms 
enumerations of sets of natural numbers into their characteristic functions). In 
proving this result we use two classical theorems: Levy’s zero-one law and Radon- 
Nikodym Theorem itself. We then give a sufficient condition on the measures to 
entail the computability of the RN derivative: this condition is the computability 
of the norm of a certain integral operator associated to the measures. 

2 Preliminaries 

2.1 Little bit of Computability via Representations 

To carry out computations on infinite objects we encode those objects into in¬ 
finite symbolic sequences, using representations (see [6] for a complete develop¬ 
ment). Let S = {0,1}. A represented space is a pair (X,S) where X is a set 


and 6 C i7 N —> X is an onto partial map. Every p £ dom(5) such that 6(p) = x 
is called a 6-name of x (or name of x when 5 is clear from the context). 

Let (X, dx) be a represented space. An element x £ X is computable if 
it has a computable name. Let (Y, Sy) be another represented space. A realizer 
for a function / : X —► Y is a (partial) function F : —> Y N such that 

f o Sx = 5y o F (with the expected compatibilities between domains). / is 
computable if it has a computable realizer. Of course the image of a computable 
element by a computable function is computable. 

Example 1. Let 2 N be the powerset of N. The classical notions of recursive and 
recursively enumerable sets can be grasped as the computable elements of the 
space 2 n endowed with two representations, Cf and En respectively, defined by: 

En(p) ={neN: 100" 1 is a subword of p} 

Cf(p) = {n £ N : Pn = 1} 

where p £ Y N , p n is the nth symbol in p. En, Cf : —> 2 N are total functions. 

We define the operator EC as the identity from represented space (2 N ,En) 
to represented space (2 N , Cf). It transforms an enumeration of a set into its 
characteristic function. EC is not computable. 

The non-computability of functions f, g between represented spaces can be 
compared using a notion of reducibility introduced in [5]: / <w g if there are 
computable (partial) functions K, H such that for every realizer G of g, p <—> 
K(p. G o H(p)) is a realizer of /. In other words, / <w 9 if / can be computed 
using one single application of g (provided by an oracle) in the computation. 4 


2.2 Computable Measurable Spaces 

We start by briefly recalling some basic definitions from measure theory. See for 
example [4,2,1] for a complete treatment. A ring fR over a set ft is a collection 
of subsets of ft which contains the empty set and is closed under finite unions 
and relative complementation {B \ A £ 3?, for A, B £ 51). A a-algebra A 
(over the set ft) is a collection of subsets of ft which contains ft and is closed 
under complementation and countable unions (and therefore also closed under 
countable intersections). A ring fR generates a unique cr-algebra, denoted by 
cr(fR), and defined as the smallest cr-algebra containing fR. 

In this paper we will work with the measurable space (ft,A), where A 
is a cr-algebra generated by a countable ring fR. Members of A = cr(fR) will be 
referred to as measurable sets. 

A measure over a collection 6 (which is at least closed by finite unions) of 
subsets of ft is a function g : C —> R°° (= III {oo}) such that i) /x(0) = 0, 
g(E) > 0 for all E £ C, and ii) /^((J^ Ei) = f(Ei) for pairwise disjoint sets 
E 0 , Ei, ... £ C such that (J i E i £ C. A measure g over a collection C is said to 

4 the relation is denoted <w as it is a generalization of Wadge reducilibility. 



be a-finite, if there are sets Eq,E\, ... £ C such that p{Ef) < oo for all i and 

fl = Ui E i- 

It is well known that a cr-finite measure over ring 1R has a unique extension 
to a measure over the u-algebra cr(fR). For measures p and A, we say that p is 
absolutely continuous w.r.t. A, and write p A, if (A(A) = 0 =>■ p(E) = 0) 
for all measurable sets E. 

We now introduce the effective counterparts. 

Definition 1 . A computable measurable space is a tuple (f2, A, A, a) where 

1. (f2,A) is a measurable space, A is a countable ring such that UlR = fi and 

A = cr(CR), 

2. a : N —> 1R is a computable enumeration such that the operations (A,B) —> 
AU B and (A, B) -+ A \ B are computable w.r.t. a. 

In the following (12, A, CR, a) will be a computable measurable space. We will 
consider only measures p : A —> [0; oo] such that p(E) < oo for every E £ A. 
Observe that such a measure p is cr-finite, and therefore well-defined by its values 
on the ring 1R. Conversely if a measure p over A is cr-finite, one can choose a 
countable generating 1R such that p(E) < oo for all E £ A. 

Computability on the space of measures over (f2,A, 1R) will be expressed via 
representations. 

Definition 2. Let M be the set of measures p such that p(E) < oo for all 
E £ l R and let M <oc be the set of all finite measures. Define representations 
(5jvt : ► M and 8 m <00 : A7 N —► M <oc as follows: 

1. <Am(p) = P, iff P is (more precisely, encodes) a list of all (, l,n,u ) € Q 3 such 
that l < p(E n ) < u, for every E n £ X. 

2. 5m <00 {p) = h: iffP = {pi 5 pf) such that 5jrt(pi) = p andp 2 is (more precisely, 
encodes) a list of all ( l,u) £ Q 2 such that l < p(f2) < u. 

Thus, a Aw-name p allows to compute p(A) for every ring element A with arbi¬ 
trary precision. A <5^[ <oo -name allows additionally to compute p(f2). Obviously, 
Am < 00 — £>vt and Ajvt <00 = Am if LI £ 1 R. But in general, not even the restriction 
of Am to the finite measures is reducible to <5jyf <oo . 

We will also work with the spaces L 1 of integrable functions and L 2 of square- 
integrable functions (w.r.t. some measure). A rational step function is a finite 
sum 

p 

s = 

fe=l 

where E ik £ A and qj k £ Q. 

The computable numberings of the ring 1R = ( Eq,Ei ,...) and of the rational 
numbers Q = ( 50 , qi, •••) induce a canonical numbering of the the collection 
IRST = (so, si,...) of rational step functions. Since the collection 1RST is dense in 
the spaces L 1 and L 2 , we can use it to handle computability over these spaces 
via the following representations: 



Definition 3. For every p £ M define Cauchy representations 5 k : .E N —> L k (p) 
of L k (p) (k = 1,2) by: 6 k (p) = f iff p is (encodes) a sequence (s no , s ni ,.. .) of 
rational step functions such that ||s ni — f\\f < 2~ l for all i £ N. 

3 Effective Radon-Nikodym Theorem 

3.1 An upper bound 

In the following, we present our first main result which, in words, says that com¬ 
putability of the Radon-Nikodym derivative is reducible to a single application 
of the (non-computable) operator EC. 

Theorem 2. The function mapping every n-finite measure A £ DVt and every 
finite measure p such that p -C A to the function h £ L 1 (X) such that p(E) = 
f E h dA for all E £ afiJV) is computable via the representations 6 ^ 1 , Sj^ <oa an d 
(5^ with a single application of the operator EC. 

For the proof, we will use the following classical result on convergence of 
conditional expectations, which is a consequence of the more general Doob’s 
martingale convergence theorems (see for example [2], Section 10.5). We recall 
that a filtration (T„) n is an increasing sequence of cr-algebras on a measurable 
space. In some sense, represents the information available at time n. In words, 
the following result says that if we are learning gradually the information that 
determines the outcome of an event, then we will become gradually certain what 
the outcome will be. 

Theorem 3 (Levy’s zero-one law). Consider a measured space (17, er(lR), A) 
with A finite. Let h £ L 1 (A). Let he any filtration such that er(3?) = 

ct(U n^n)- Then 

E(h\3 n ) —> h 

n—>oo 

both X-almost everywhere and in L 1 (A). 

Proof (of Theorem 2). We start by proving the result for finite measures. 

Lemma 1. From descriptions of finite measures p •C A, one can compute a 
sequence {ft n }neN of L 1 (X)~computable functions which converges in L 1 ( A) to 
the Radon-Nikodym derivative h = £ L 1 ) A). 

Proof. Consider the computable enumeration Eq, E\,... of Ik. For every n, con¬ 
sider the partition T n of the space given by the cells: 

— all the possible Eq n E( D... fl E* where E* is either E or (Eq U... U E n )\E, 

— all the Ek+i \ (Eq U ... U Ek) for every k > n. 


Observe that all the cells are elements of the ring !R. The partitions induce 
a filtration which generates the cr-algebra <r(!R). Let h be the RN-derivative 5 of 
/i w.r.t. A. h £ A 1 (A) so by Levy’s zero-one law, 

E(/i|3>„) —> h 

n—> oo 

both A-almost everywhere and in A 1 (A). 

Now, h n := E(/i|lP n ) is constant on each cell C of CP n , with value if 
A (C) > 0 and 0 otherwise. We now show that the functions h n are (uniformly) 
computable elements of L 1 (A). For a given e, one can find cells Ci, ...,Ck in y n 
such that A (Ci) > 0 for all i = 1 ,k and £A =1 /i(Ci) > /j,(f2)—e. Define h e n to be 
constant with value for i = 1,..., k and 0 on the other cells. As these values 
are uniformly computable, the functions h e n are uniformly L 1 (A)-computable. 
Moreover 

/ \h n — h e n \ dA = / h„ dA < e 

J Ci 

and thus, the functions h n are (uniformly) computable elements of L 1 (A), and 
converge to h in L 1 (A). The lemma is proved. 

Assume now that fi £ M <oc and A £ M. Let once again (E 0 ,Ei,...) be 
the computable numbering of the ring 3L Let Fq := Eq and F n +\ := E n+ i \ 
{F 0 ,..., F n }. Then (F,),; is a computable numbering of ring elements such that 
Fi n Fj = 0 for i ^ j and f2 = {J i Fi. 

Since i i—> i-i(Fj) is computable, there is a computable function d : N —> N 
such that d(i) > n(Fi) ■ 2®. Define a function w : fl —> R by w(x) := 1 /d(i) if 
x £ Fi. Then 

Jw d\ = Y,»{Fi)/d{i)< 2. 

i 

Define a new measure v by 


v{E) := f rcdA. (1) 

J E 

for all E £ 3L Then v is a finite measure, which is equivalent to A (i.e. v <C A <C v) 
and such that a Avt-nauie of v can be computed from a <5]yt-name of A. Apply 
Lemma 1 to and v. one can compute a sequence of L 1 (^)-computable functions 
whose limit (in L 1 (^)) is the density h' = gp. The sequence {h' n w} is 
computable and converges (in A 1 (A)) to h = ^ = wh’. At this point we use the 
operator EC to extract a fast convergent subsequence, and hence to compute (a 
(5^-name of) h. The proof is complete. 

The above theorem shows that the Radon-Nikodym theorem is reducible to 
the (non-computable) operator EC. On the other hand, it was shown in [3] that 

at this point we use the classical RN theorem 


5 




there exists a computable measure on the unit interval, absolutely continuous 
w.r.t. Lebesgue measure, and such that the operator EC can be reduced to the 
computation of the density (which is therefore not L 1 -computable). This give us 
the following corollary. 

Corollary 1. For nontrivial computable measurable spaces, the Radon-Nikodym 
operator and EC are equivalent: RN EC. 

This result characterize the extent to which the Radon-Nikodym theorem is 
non-computable. However, it doesn’t give us much information on “where” is 
the non-effectivity. In what follows we present a result which gives an explicit 
condition (in terms of the computability of the norm of a certain linear operator 
involving the two measures) allowing to compute the Radon-Nikodym derivative. 
The proof of this result is somewhat more involved, and some preparation will 
be required. 

3.2 Locating the non-computability 

Let p £ M <00 be a finite measure over Let u : L 2 (p) —» R be a linear 

functional. Classically we have that the following are equivalent: 

1. u is continuous, 

2. u is uniformly continuous, 

3. there exists c (a bound for u ) such that for every / £ L 2 (p), |u(/)| < c11/11 2 - 

The smallest bound for u is called the norm, of u and is denoted by ||w||. 
That is, 

IN := sup{c £ R : |u(/)| < c||/|| 2 } = sup |u(/)|. 

imh=i 

Suppose that the operator u is computable in the sense that one can compute 
the real number u(f) from (a ctM-name of) p and (a (5^-name of) /. Consider 
now the numbered collection 1RST = {r n } ne N. Since the sequence Sj := .Tv is 
uniformly computable (from p) and dense in {/ £ L 2 (p) : ||/|| 2 = 1}, it follows 
that the norm ||tt|| of a computable operator u is always a lower-computable 
(from p) number. It is not, in general, computable. In case it is computable, we 
will say that the operator u is computably normable. 

The following result is an effective version of Riesz-Frechet Representation 
Theorem. For simplicity, we state the result in the particular Hilbert space L 2 (p), 
but the same proof works for any Hilbert Space provided that the inner product 
is computable. 

Theorem 4. Let u be a non-zero computably normable (from p) linear func¬ 
tional over L 2 (p). Then from p one can compute a name of (the unique) g £ 
L 2 (p) such that 



for all f £ L 2 [p). 



Proof. In the following, all what we will compute will be from a djyt-name of g. 
Chose any computable x £ L 2 (g) out of ker(u). As ||u|| is computable, from the 
classical formula d(x,ker(u)) = , it follows that d(x,ker(u)) is computable 

too. We can then enumerate a sequence of points y n € E = ker(u) + x which is 
dense in E. Note that d(0,E) = d(x,ker(u)). Let Zo £ E be such that ||zo|j = 
d(0,E). Since 

\\y n -Z 0 \\ 2 = \\y n \\ 2 -\\z 0 \\ 2 

we can compute a subsequence y rii converging effectively to zq which is therefore 
computable. Put z = so that ||;z|| = 1. All what remains is to show that 
g = u(z)z (which is computable) satisfies the required property. This is done as 
in the classical proof, namely: z has the property of being orthogonal to ker(u). 
That is, fzfdg = 0 for any / £ ker{u). Put 

r := u(f)z - u(z)f. 

We have u[r) = u(f)u(z) — u(z)u(f ) = 0 so that r £ ker(u ) and then 
frz dg = 0. This gives, 

«(/)=«(/) Jz 2 dn = Ju(f)z 2 dg = j (r + u(z)f)zdg = jfu{z)zdg 
and hence g = u(z)z, as was to be shown. 

Remark 1. Let /j be a finite measure. For /, g in L 2 (/z), Holder’s inequality im¬ 
plies that fg £ L l (y) and: 


Wf9h < II/II2NI2 ( 2 ) 

so that, in particular, since g is finite, if / £ L 2 then f £ L 1 (taking g = 1). 
Moreover, from a i5 2 -name of / one can compute a d^-name. 

Now, let g and A be finite measures and consider a new measure <p := g + v. 
Let Ln : L 2 (ip) —* R be defined by L M (/) := J f dg. This is a bounded operator 
and it is easy to see that from d^-names of g and A and from a 5 2 -name of /, 
one can compute the value 

Definition 4. A finite measure g is said to be computably normable rela¬ 
tive to some other finite measure A, if the norm of the operator (as defined 
above) is computable from g and A. 

At this point, we are ready to state our second main result. 

Theorem 5. Let g, A £ M <00 be such that: 

(i) g <C A, 

(ii) g is computably normable relative to A. 

Then the Radon-Nikodym derivative can be computed as an element of L 1 ( A), 
from g and A. 



Proof. We follow Von Neumann’s proof. The measure ip := p + A is computable 
and by hypothesis the operator : L 2 (ip) —> M defined by := Jf dp is 

computably normable. Hence, by Theor. 4 one can compute a name of g £ L 2 (ip) 
(and hence a name of g as a point in L 1 (A)) such that for all / £ L 2 (p) the 
equality: 


J fdp = J fgdp = J fgdX + J fgdp (3) 

holds. This relation can be rewritten as: 

JfgdX = Jf(l -g)dp. (4) 

Note that (4) holds for any / > 0 (take f n = fl{f <n y and apply monotone 
convergence theorem). Taking / = l{ g= u in (4) we see that A({</ = 1}) = 0. 
Hence the following function is defined A-almost everywhere: 



Taking / = l{ s <o} and l{ s >i} in (4) we see that 0 < g < f A-a.e., so h > 0 
A-a.e. Therefore, 

= /(l4^)( 1 -5)^ by (4) 

= J f d ( . 

Now, taking / to be the constant function equal to f, we conclude that 
fhdX = 1 and then it is in T 1 (A). This shows that h is the Radon-Nikodym 
derivative. 

It remains to show that the function h = is L 1 (A)-computable. 

As g is L 1 (A)-computable, we can effectively produce a sequence Ui of rational 
step functions such that ||iq — g|| A < 2 _I . As g > 0 A-a.e. we can assume w.l.o.g. 
that Uf > 0 (otherwise replace iq with max(rq,0)). 

For n £ N let 


g n ■= min(5, 1 - 2 n ) h n := g n /{ 1 - g n ) 

u in := min(uj, 1 - 2 ~ n ) v in := u in /(l - u in ) 

Since the function x 1 —> x/{\ — x) is nondecreasing over (0, + 00 ), 


g n < g n + 1 and sup g n = g , 

n 

h n < h n+ 1 and sup h n = h . 

n 





Given a rational number e > 0 we show how to compute n and i such that 

\\ h -Vin\\ X < e. 


Vi n will then be a rational step function approximating h up to e, in L l { A). As 
a result, it will enable to compute a <5^-name of h. 

To find n and i. we use the following inequality 

||^ 'GnH;^ ||^' ^n|| A T ||^n Gn \ \ \ (5) 

We first make the first term small. As for all n, 0 < h n < h, one has 
\\h - h n || A = \\h\\ x - ||/i„|| A . As \\h\\ x = n(f2) is given as input and \\h n \\ x can be 
computed from n, one can effectively find n such that \\h\\ x — ||/i„|| A < e/2. 

We then make the second term in (5) small: 


Vin || \ — 

9n 

^in 

1 - 9n 

1 'Uin 


9n ^in 


(1 9n){X 'U'in) 


< \\9n-u in \\ x - 2 2 " 

< \\9n-U in \\l-2 2n 

<\\g-Ui\\l-2 2n 

< 2~ i ■ 2 2n . 

We then compute i such that 2~ l ■ 2 2n < e/2. One finally gets the expected 
inequality 

||^ ni n || A ^ || h ^n|| A T ||^'n ^'in|| A ^ C 

and the result follows. 
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